@greedy52 From what I understand the problem comes from the fact that mongo driver creates multiple TCP connections per one DB connection (if you can phrase it in this way). Have you tried to use some driver options to control that?
For example SetMaxPoolSize() https://github.com/mongodb/mongo-go-driver/blob/ae48c67470353306985af3466d20d1241d972296/mongo/options/clientoptions.go#L575-L581 ?
I think that assumption that the connection count is +/- 3 can bite us when if the driver changes the behaviour (after update for example).

@greedy52 From what I understand the problem comes from the fact that mongo driver creates multiple TCP connections per one DB connection (if you can phrase it in this way). Have you tried to use some driver options to control that? For example SetMaxPoolSize() https://github.com/mongodb/mongo-go-driver/blob/ae48c67470353306985af3466d20d1241d972296/mongo/options/clientoptions.go#L575-L581 ? I think that assumption that the connection count is +/- 3 can bite us when if the driver changes the behaviour (after update for example).

@jakule I have tried SetMaxPoolSize and it has no effect. So the same single connection is used for auth, ping, and our query. (so effectively max pool size is 1 without explicitly setting it). However, I am seeing other connections are spamming isMaster calls and they don't respect the pool size. In fact, if you set min pool size to a bigger number say 10, you may 30 connections. Something is fishy. Let me dig into mongo driver a little bit more.

@jakule @smallinsky as suggested by Jakub, I did some more digging into this and got some bad news.

The mongo client does have a connection pool, which controls connection pool size and can be monitored by options.Client().SetPoolMonitor. In our tests, there is only one connection created in the pool.

So besides the connection pool, the client also creates TWO other connections to the server that is not from this pool. For example, a background rttMonitor creates a separate connection to send isMaster.

So, our mongo engine receives 3 connections per client. The worst part is we are multiplying this since we use the same driver. For each incoming connection to the engine, we establish 3 to the actual server. This multiplies. So 3 * 3 = 9.

I guess one of the background tasks doesn't get caught all the time, so we are seeing 2 * 3 = 6 from time to time.

I don't the multiplying effect will be an easy fix. I will create an separate issue to track

@greedy52 can we get this backported to v9 and v8?